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Abstract 

We consider the problem of positioning a cloud of points in the Euclidean space M. d , using 
noisy measurements of a subset of pairwise distances. This task has applications in various areas, 
such as sensor network localization and reconstruction of protein conformations from NMR 
measurements. Also, it is closely related to dimensionality reduction problems and manifold 
learning, where the goal is to learn the underlying global geometry of a data set using local (or 
partial) metric information. Here we propose a reconstruction algorithm based on semidefinite 
programming. For a random geometric graph model and uniformly bounded noise, we provide 
a precise characterization of the algorithm's performance: In the noiseless case, we find a radius 
r beyond which the algorithm reconstructs the exact positions (up to rigid transformations). 
In the presence of noise, we obtain upper and lower bounds on the reconstruction error that 
match up to a factor that depends only on the dimension d, and the average degree of the nodes 
in the graph. 

1 Introduction 

1.1 Problem Statement 

Given a set of n nodes in the localization problem requires to reconstruct the positions of the 
nodes from a set of pairwise measurements d^ for (i,j) G E C {1, . . . , n} x {1, . . . , n}. An instance 
of the problem is therefore given by the graph G = (V,E), V = {l,...,n}, and the vector of 
distance measurements dy associated to the edges of this graph. 

In this paper we consider the random geometric graph model G(n, r) = (V, E) whereby the n 
nodes in V are independent and uniformly random in the (i-dimensional hypercube [—0.5, 0.5] rf , and 
E € V x V is a set of edges that connect the nodes which are close to each other. More specifically 
we let (i,j) 6 E if and only if dij = \\xi — Xj\\ < r. For each edge £ E, dij denotes the 

measured distance between nodes i and j. Letting za = df, — df, the measurement error, we will 
study a "worst case model", in which the errors are arbitrary but uniformly bounded 

\zij\ < A. We propose an algorithm for this problem based on semidefinite programming and 
provide a rigorous analysis of its performance, focusing in particular on its robustness properties. 

Notice that the positions of the nodes can only be determined up to rigid transformations (a 
combination of rotation, reflection and translation) of the nodes, because the inter point distances 
are invariant to rigid transformations. For future use, we introduce a formal definition of rigid 
transformation. Let X £ W ixd be the matrix whose i th row, xf G M. d , is the coordinate of node i. 
Further, let 0(d) denote the orthogonal group of d x d matrices. A set of positions Y 6 R nxd is a 
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rigid transform of X, if there exists a d-dimensional shift vector s£K' ! and an orthogonal matrix 
O G 0(d) such that 

Y = XO + us T . (1) 

Throughout u G 1" is the all-ones vector. Therefore, Y is obtained as a result of first rotating 
(and/or reflecting) nodes in position X by matrix O and then shifting by s. Also, two position 
matrices X and Y are called equivalent up to rigid transformation, if there exists O G 0(d) and 
a shift s G M. d such that y = XO + us T . We use the following metric, similar to the one defined 
in [16], to evaluate the distance between the original position matrix X G M. nxd and the estimation 
X G R n xd . Let L = I— (1/ n)uu T be the centering matrix . Note that L is an n x n symmetric matrix 
of rank n—1 which eliminates the contribution of the translation, in the sense that LX = L(X +us T ) 
for all s G M d . Furthermore, LXX T L is invariant under rigid transformation and LXX L = LXX T L 
implies that X and X are equal up to rigid transformation. The metric is defined as 



d(X,X) = \\\LXX T L - LXX T L\U. (2) 



This is a measure of the average reconstruction error per point, when X and X are aligned optimally. 
To get a better intuition about this metric, consider the case in which all the entries of LXX T L — 
are roughly of the same order. Then 



d(X,X) « d 2 (X,X) = -\\LXX T L- LXX T L\\ F . 

n 



Denote by Y = X — X the estimation error, and assume without loss of generality that both X 
and X are centered. Then for small Y, we have 

d 2 (X,X) = -\\XY T + YX T + YY T \\ F sa -\\XY T + YX T \\ F 
n 





where the bound(a) holds with high probability for a suitable constant C, if X is distributed 
according to our modelQ 

Remark. Clearly, connectivity of G is a necessary assumption for the localization problem to be 
solvable. It is a well known result that the graph G(n, r) is connected w.h.p. if K^r d > (log n+c n )/n, 
where is the volume of the <i-dimensional unit ball and c n — > oo [18 . Vice versa, the graph is 
disconnected with positive probability if KdT d < (log n + C)/n for some constant C. Hence, we 
focus on the regime where r > a(\ogn/n) l / d for some constant a. We further notice that, under 
the random geometric graph model, the configuration of the points is almost surely generic, in the 
sense that the coordinates do not satisfy any nonzero polynomial equation with integer coefficients. 

1.2 Algorithm and main results 

The following algorithm uses semidefinite programming (SDP) to solve the localization problem. 



1 Estimates of this type will be repeatedly proved in the following 
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Algorithm SDP-based Algorithm for Localization 
Input: dimension d, distance measurements dij 
for G E, bound on the measurement noise A 
Output: estimated coordinates in JR d 
1: Solve the following SDP problem: 
minimize Tr(Q) 

s.t. (Mij,Q) - dij 2 < A, G E 

QhO. 

2: Compute the best rank-ci approximation Ud^dUj of Q 
3: Return X = U d ^J 2 • 

Here My = e^e^ G M" - *™, where ejj G 1" is the vector with +1 at i th position, — 1 at j th position 
and zero everywhere else. Also, (A, B) = Tv(A T B). Note that with a slight abuse of notation, the 
solution of the SDP problem in the first step is denoted by Q. 

Let Qo := XX T be the Gram matrix of the node positions, namely Qoij = x% ■ Xj. A key 
observation is that Qo is a low rank matrix: rank(Qo) < d, and obeys the constraints of the SDP 
problem. By minimizing Tr(Q) in the first step, we promote low-rank solutions Q (since Tr(Q) is 
the sum of the eigenvalues of Q). Alternatively, this minimization can be interpreted as setting the 
center of gravity of {x±, . . . ,x n } to coincide with the origin, thus removing the degeneracy due to 
translational invariance. 

In step 2, the algorithm computes the eigen-decomposition of Q and retains the d largest 
eigenvalues. This is equivalent to computing the best rank-d approximation of Q in Frobenius 
norm. The center of gravity of the reconstructed points remains at the origin after this operation. 

Our main result provides a characterization of the robustness properties of the SDP-based 
algorithm. Here and below 'with high probability (w.h.p.)' means with probability converging to 
1 as n — > oo for d fixed. 

Theorem 1.1. Let {x±, . . . ,x n } be n nodes distributed uniformly at random in the hypercube 
[— 0.5, 0.5] d . Further, assume connectivity radius r > ailogn/n) 1 ^ , with a > lOv^- Then w.h.p., 
the error distance between the estimate X returned by the SDP-based algorithm and the correct 
coordinate matrix X is upper bounded as 

d(X,X)<C\(nr d f^. (3) 
Conversely, w.h.p., there exist adversarial measurement errors {zij}^j^^ such that 

d(X,X)>C 2 mm{^,l}, (4) 

Here, C\ and Ci denote universal constants that depend only on d. 

The proof of this theorem relies on several technical results of independent interest. First, we 
will prove a general deterministic error estimate in terms of the condition number of the stress 



matrix of the graph G, see Theorem 5.1 Next we will use probabilistic arguments to control the 



stress matrix of random geometric graphs, see Theorem 5.2 Finally, we will prove several estimates 



on the rigidity matrix of G, cf. in particular Theorem 6.1 The necessary background in rigidity 



theory is summarized in Section 2.1 
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1.3 Related work 



The localization problem and its variants have attracted significant interest over the past years 
due to their applications in numerous areas, such as sensor network localization [6], NMR spec- 
troscopy |14j . and manifold learning \19\ I23|. to name a few. 

Of particular interest to our work are the algorithms proposed for the localization problem |16| 
[2"T| El [23]. In general, few performance guarantees have been proved for these algorithms, in 
particular in the presence of noise. 

The existing algorithms can be categorized in to two groups. The first group consists of algo- 
rithms who try first to estimate the missing distances and then use MDS to find the positions from 
the reconstructed distance matrix [IB] HO]. MDS-MAP [10] and ISOMAP [23] are two well-known 
examples of this class where the missing entries of the distance matrix are approximated by com- 
puting the shortest paths between all pairs of nodes. The algorithms in the second group formulate 
the localization problem as a non-convex optimization problem and then use different relaxation 
schemes to solve it. An example of this type is relaxation to an SDP [61 [22j [251 (II IS]- A crucial 
assumption in these works is the existence of some anchors among the nodes whose exact positions 
are known. The SDP is then used to efficiently check whether the graph is uniquely d-localizable 
and to find its unique realization. 

Maximum Variance Unfolding (MVU) is an SDP-based algorithm with a very similar flavor as 
ours [24J. MVU is an approach to solving dimensionality reduction problems using local metric 
information and is based on the following simple interpretation. Assume n points lying on a low 
dimensional manifold in a high dimensional ambient space. In order to find a low dimensional 
representation of this data set, the algorithm attempts to somehow unfold the underlying manifold. 
To this end, MVU pulls the points apart in the ambient space, maximizing the total sum of their 
pairwise distances, while respecting the local information. However, to the best of our knowledge, 
no performance guarantee has been proved for the MVU algorithm. 

Given the large number of applications, and computational methods developed in this broad 
area, the present paper is in many respects a first step. While we focus on a specific model, and 
a relatively simple algorithm, we expect that the techniques developed here will be applicable to a 
broader setting, and to a number of algorithms in the same class. 



1.4 Organization of the paper 

The remainder of this paper is organized as follows. Section [2] is a brief review of some notions in 
rigidity theory and some properties of G(n, r) which will be useful in this paper. In Section [3j we 
discuss the implications of Theorem 1.1 in different applications. The proof of Theorem |1.1| (upper 
bound) is given in Section |4j Sections [5] and [6] contain the proof of two important lemmas used 
in proving Theorem Several technical steps are discussed in Appendices. Finally, We prove 
Theorem |1.1| (lower bound) in Section [7j 

For the reader's convenience, an overview of the symbols used throughout this paper is given 
in Table [T] in Appendix [N] 
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2 Preliminaries 



2.1 Rigidity Theory 

Rigidity theory studies whether a given partial set of pairwise distances d™ = \\xi — Xj\\ between a 
finite set of nodes in M. d uniquely determine the coordinates of the points up to rigid transformations. 
This section is a very brief overview of definitions and results in rigidity theory which will be useful 
in this paper. We refer the interested reader to [131 12], for a thorough discussion. 

A framework Gx in M is an undirected graph G = (V, E) along with a configuration X G W ixd 
which assigns a point X\ G M rf to each vertex i of the graph. The edges of G correspond to the 
distance constraints. In the following, we discuss two important notions, namely Rigidity matrix 
and Stress matrix. As mentioned above, a crucial part of the proof of Theorem |1.1| consists in 
establishing some properties of the stress matrix and of the rigidity matrix of the random geometric 
graph G(n, r). 

Rigidity matrix. Consider a motion of the framework with Xi(t) being the position vector of 
point i at time t. Any smooth motion that instantaneously preserves the distance dij must satisfy 
■jft\\xi — Xj\\ 2 = for all edges Equivalently, 

(xi - Xj) T (xi - Xj) = V(i, j) G E, (5) 

where x~i is the velocity of the i th point. Given a framework Gx G a solution X = [ 
with Xi G M d , for the linear system of equations ^ is called an infinitesimal motion of the frame- 
work Gx- This linear system of equations consists of \E\ equations in dn unknowns and can be 
written in the matrix form Rq(X)X = 0, where Rg(X) is called the \E\ x dn rigidity matrix of 
Gx- 

It is easy to see that for every anti-symmetric matrix A G ~R dxd and for every vector b G M. d , 
Xi = Axi + b is an infinitesimal motion. Notice that these motions are the derivative of rigid 
transformations. (A corresponds to orthogonal transformations and b corresponds to translations). 
Further, these motions span a d{d+l)/2 dimensional subspace of M. dn , accounting d(d—l)/2 degrees 
of freedom for orthogonal transformations (corresponding to the choice of A), and d degrees of 
freedom for translations (corresponding to the choice of b). Hence, dim Ker(i2c(X)) > d{d + l)/2. 
A framework is said to be infinitesimally rigid if dim Ker(i?c(A)) = d(d + l)/2. 

Stress matrix. A stress for a framework Gx is an assignment of scalars ojij to the edges such 
that for each i G V, 

u)ij(xi - Xj) = ( Uij)xi- ^2 UijXj = 0. 

A stress vector can be rearranged into an n x n symmetric matrix Q , known as the stress matrix, 
such that for i ^ j, the entry of is Ojj = — uiij, and the diagonal entries for (i,i) are 

= Since all the coordinate vectors of the configuration as well as the all-ones vector 

are in the null space of O, the rank of the stress matrix for generic configurations is at most n — d—1. 

There is an important relation between stress matrices of a framework and the notion of global 
rigidity. A framework Gx is said to be globally rigid in M. d if all frameworks in W 1 with the same set 
of edge lengths are congruent to Gx, i-e. are a rigid transformation of Gx- Further, a framework 
Gx is generically globally rigid in M. d if Gx is globally rigid at all generic configurations X. (Recall 
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that a configuration of points is called generic if the coordinates of the points do not satisfy any 
nonzero polynomial equation with integer coefficients). 

The connection between global rigidity and stress matrices is demonstrated in the following two 
results proved in [9] and [15] . 

Theorem 2.1 (Connelly, 2005). If X is a generic configuration in M d with a stress matrix f2 of 
rank n — d — 1, then Gx is globally rigid in ~R. d . 

Theorem 2.2 (Gortler, Healy, Thurston, 2010). Suppose that X is a generic configuration in M. d , 
such that Gx is globally rigid in Then either Gx is a simplex or it has a stress matrix Q with 
rank n — d — 1 . 

Among other results in this paper, we construct a special stress matrix Q for the random 
geometric graph G(n,r). We also provide upper bound and lower bound on the maximum and 
the minimum nonzero singular values of this stress matrix. These bounds are used in proving 
Theorem 11.11 



2.2 Some Properties of G(n,r) 

In this section, we study some of the basic properties of G(n, r) which will be used several times 
throughout the paper. 

Our first remark provides probabilistic bounds on the number of nodes contained in a region 
K C [-0.5,0.5] d . 

Remark 2.1. [Sampling Lemma] Let 1Z be a measurable subset of the hypercube [— 0.5,0. 5] d , 
and let V(1Z) denote its volume. Assume n nodes are deployed uniformly at random in [—0.5, 0.5] d , 
and let n(lZ) be the number of nodes in region TZ. Then, 

n(K) E nV(K) + [-^2cnV{K) logra, y / 2cnV(K) logn], (6) 

with probability at least 1 — 2/n c . 

The proof is immediate and deferred to Appendix [Aj 

In th e gr aph G(n, r), every node is connected to all the nodes within its r- neighborhood. Using 
Remark 
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for r-neighborhood of each node, and the fact r > 10v / d(logn/n) 1//rf , we obtain the 
following corollary after applying union bound over all the r-neighborhoods of the nodes. 

Corollary 2.1. In the graph G(n,r), with r > lOv^log n/n) l l d , the degrees of all nodes are 
in the interval [(l/2)Kdnr d , (3/2) K<inr d ], with high probability. Here, Kd is the volume of the 
d-dimensional unit ball. 

Next, we discuss some properties of the spectrum of G(n,r). 

Recall that the Laplacian C of the graph G is the symmetric matrix indexed by the vertices 
V, such that £jj = —1 if E E, Ca = degree(i) and Cij = otherwise. The all-ones vector 
u E M n is an eigenvector of C(G) with eigenvalue 0. Further, the multiplicity of eigenvalue in 
spectrum of C(G) is equal to the number of connected components in graph G. Let us stress that 
our definition of C(G) has opposite sign with respect to the one adopted by part of the computer 
science literature. In particular, with the present definition, C(G) is a positive semidefinite matrix. 

It is useful to recall a basic estimate on the Laplacian of random geometric graphs. 
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Remark 2.2. Let C n denote the normalized Laplacian of the random geometric graph G(n,r), 
defined as £ n = D^ 1 / 2 CD~ 1 / 2 , where D is the diagonal matrix with degrees of the nodes on 
diagonal. Then, w.h.p., \2(C n ), the second small est e igenvalue of £ n , is at least Cr 2 ([HUB])- Also, 
using the result of [8] (Theorem 4) and Corollary 2.1 we have A2(£) > C(nr d )r 2 , 
C = C(d). 



for some constant 



2.3 Notations 

For a vector v £ W 1 , and a subset T C {1, • ■ • , n} , vt £ is the restriction of v to indices in T. 
We use the notation (v%, ■ ■ ■ ,v n ) to represent the subspace spanned by vectors v%, 1 < i < n. The 
orthogonal projections onto subspaces V and V 1 - are respectively denoted by Py and Py. The 
identity matrix, in any dimension, is denoted by /. Further, always refers to the i th standard 
basis element, e.g., e\ = (1, 0, ■ ■ • , 0). Throughout this paper, u £ M n is the all-ones vector and C 
is a constant depending only on the dimension d, whose value may change from case to case. 

Given a matrix A, we denote its operator norm by ||^4||2i its Frobenius norm by its 
nuclear norm by ||^4||*, and its £i-norm by ||^4||i- (||j4||* is simply the sum of the singular values of 
A and ||A||i = £V We also use <r max (^4) and a m m(A) to respectively denote the maximum 

and the minimum nonzero singular values of A. 

For a graph G, we denote by V(G) the set of its vertices and we use E(G) to denote the set of 
edges in G. Following the convention adopted above, the Laplacian of G is represented by £>{G). 

Finally, we denote by 6 W 1 , i G {l,...,d} the i th column of the positions matrix X. In 
other words is the vector containing the i th coordinate of points x\ 1 . . . , x n . 

Throughout the proof we shall adopt the convention of using the notations X, {^j}jg[„], and 
{x^}ie{d] to denote the centered positions. In other words X = LX' where the rows of X' are i.i.d. 
uniform in [— 0.5, 0.5] a! . 



3 Discussion 



In this section, we make some remarks about Theorem 1.1 and its implications. 
Tightness of the Bounds. The upper and the lower bounds in Theorem |1.1| match up to the 
factor C(nr d ) 5 . Note that nr d is the average degree of the nodes in G (up to a constant) and 
when the rang r is of the same order as the connectivity threshold, i.e., r = O ((log n/n) 1 ^), it 
is logarithmic in n. Furthermore, we believe that this factor is the artifact of our analysis. The 
numerical experiments in Section [8] also support the idea that the performance of the SDP-based 
algorithm, evaluated by d(X, X), scales as CA/r 4 for some constant C. In addition, the theorem 
states the bounds for r > a(log n/n) l / d , with a > lOv^- However, numerical experiments in 
Section [8] show that the bounds hold for much smaller a, namely a > 3 for d = 2,4. Finally, it 
is immediate to see that under the worst case model for the measurement errors, no algorithm 
can perform better than CA/r 2 . More specifically, for any algorithm d(X, X) > CA/r 2 , for some 



,~ 2 



constant C. The reason is that letting dij = (1 + A/r )djj, no algorithm can differentiate between 
X and its scaled version X = ^/l + A/r 2 X. Also d(X,X) = (A/r 2 )(l/n 2 )\\LXX T L\\i > CA/r 2 , 
w.h.p. and for some constant C that depends on the dimension d. 

Global Rigidity of G(n,r). As a special case of Theorem |1.1| we can consider the problem of 
reconstructing the point positions from exact measurements. The case of exact measurements was 
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also studied recently in [20] following a different approach. This corresponds to setting A = 0. The 
underlying question is whether the point positions {xj}j e y can be efficiently determined (up to a 
rigid motion) by the set of distances {dij}u^\^. If this is the case, then, in particular, the random 
graph G(n, r) is globally rigid. 

Since the right-hand side of our error bound Eq. ^ vanishes for A = 0, we immediately obtain 
the following. 

Corollary 3.1. Let {x\ , . . . , x n } be n nodes distributed uniformly at random in the hypercube 
[— 0.5,0. 5} d . If r > 10\/(i(log n/n) x l d , and the distance measurements are exact, then w.h.p., the 
SDP-based algorithm recovers the exact positions (up to rigid transformations). In particular, the 
random geometric graph G(n,r) is w.h.p. globally rigid if r > 10\/(i(log n/n) l / d . 

In [3], the authors prove a similar result on global rigidity of G(n,r). Namely, they show that 
if n points are drawn from a Poisson process in [0, l] 2 , then the random geometric graph G(n, r) is 
globally rigid w.h.p. when r is of the order y/\og n/n. 

As already mentioned above, the graph G(n, r) is disconnected with high probability if r < 
K~ l/d {{\ogn + C)/n) 1 / d for some constant C. Hence, our result establishes the following rigidity 
phase transition phenomenon: There exist dimension-dependent constants C\(d), C2(d) such that a 
random geometric graph G(n, r) is with high probability not globally rigid if r < Ci(d)(\ogn/n) 1 ^ d , 
and with high probability globally rigid if r > C2 (d) (log n/n) l / d . Applying Stirling formula, it is 
easy to see that the above arguments yield C\(d) > C\^Vd and C2(d) < C2,*Vd for some numerical 
(dimension independent) constants C^*, C2,* . 

It is natural to conjecture that the rigidity phase transition is sharp. 

Conjecture 1. Let G(n,r n ) be a random geometric graph with n nodes, and range r n , in d 
dimensions. Then there exists a constant C*{d) such that, for any e > 0, the following hap- 
pens. If r n < (C*(d) — e) (log n/n) 1 ' d ! then G(n,r n ) is with high probability not globally rigid. If 
r n > (C*(d) + e) (log n/n) 1 ' d , then G(n,r n ) is with high probability globally rigid. 

Sensor Network Localization. Research in this area aims at developing algorithms and systems 
to determine the positions of the nodes of a sensor network exploiting inexpensive distributed 
measurements. Energy and hardware constraints rule out the use of global positioning systems, 
and several proposed systems exploit pairwise distance measurements between the sensors |17} [T5] . 
These techniques have acquired new industrial interest due to their relevance to indoor positioning. 
In this context, global positioning systems are not a method of choice because of their limited 
accuracy in indoor environments. 

Semidefinite programming methods for sensor network localization have been developed starting 
with [6 J . It is common to study and evaluate different techniques within the random geometric graph 
model, but no performance guarantees have been proven for advanced (SDP based) algorithms, 
with inaccurate measurements. We shall therefore consider n sensors placed uniformly at random 
in the unit hypercube, with ambient dimension either d = 2 or d = 3 depending on the specific 
application. The connectivity range r is dictated by various factors: power limitations; interference 
between nearby nodes; loss of accuracy with distance. 

The measurement error Zij depends on the method used to measure the distance between nodes 
i and j. We will limit ourselves to measurement errors due to noise (as opposed -for instance- 
to malicious behavior of the nodes) and discuss two common techniques for measuring distances 
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between wireless devices: Received Signal Indicator (RSSI) and Time Difference of Arrival (TDoA). 
RSSI measures the ratio of the power present in a received radio signal (P r ) and a reference 
transmitted power (P s )- The ratio P r /P s is inversely proportional to the square of the distance 
between the receiver and the transmitter. Hence, RSSI can be used to estimate the distance. It 
is reasonable to assume that the dominant error is in the measurement of the received power, and 
that it is proportional to the transmitted power. We thus assume that there is an error e P s in 
measuring the received power P r ., i.e., P r = P r + e P s , where P r denotes the measured received 
power. Then, the measured distance is given by 

4 - % = y r ■ + y/)' 1 - jr - y/) « 4U - cd%e). (7) 



Therefore the overall error \z%j\ oc df^e and its magnitude is A oc r 4 e. Applying Theorem 
obtain an average error per node of order 



1.1 



we 



d(X,X) < C[{nr d fe. 

In other words, the positioning accuracy is linear in the measurement accuracy, with a propor- 
tionality constant that is polynomial in the average node degree. Remarkably, the best accuracy 
is obtained by using the smallest average degree, i.e. the smallest measurement radius that is 
compatible with connectivity. 

TDoA technique uses the time difference between the receipt of two different signals with 
different velocities, for instance ultrasound and radio signals. The time difference is proportional 
to the distance between the receiver and the transmitter, and given the velocity of the signals the 
distance can be estimated from the time difference. Now, assume that there is a relative error e 
in measuring this time difference (this might be related to inaccuracies in ultrasound speed). We 
thus have tij = ijj(l + e), where tij is the measured time while tij is the 'ideal' time difference. 
This leads to an error in estimating dij which is proportional to dijS. Therefore, \zij\ oc df^e and 
A oc r 2 e. Applying again Theorem |l.l[ we obtain an average error per node of order 

d(X,X) < C[(nr d f^. 

In other words the reconstruction error decreases with the measurement radius, which suggests 
somewhat different network design for such a system. 

Let us stress in passing that the above error bounds are proved under an adversarial error model 
(see below). It would be useful to complement them with similar analysis carried out for other, 
more realistic, models. 

Manifold Learning. Manifold learning deals with finite data sets of points in ambient space M. N 
which are assumed to lie on a smooth submanifold A4 d of dimension d < N. The task is to recover 



A4 given only the data points. Here, we discuss the implications of Theorem 1.1 for applications 
of SDP methods to manifold learning. 

It is typically assumed that the manifold A4 d is isometrically equivalent to a region in 'K d . For 
the sake of simplicity we shall assume that this region is convex (see [12] for a discussion of this 
point). With little loss of generality we can indeed identify the region with the unit hypercube 
[— 0.5, 0.5} d . A typical manifold learning algorithm ( |23j and [24] ) estimates the geodesic distances 
between a subset of pairs of data points djv{{yi) Vj)i Ui £ K , and then tries to find a low-dimensional 
embedding (i.e. positions Xi E ~M. d ) that reproduce these distances. 
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The unknown geodesic distance between nearby data points yi and yj, denoted by dM(yi,Uj), 
can be estimated by their Euclidean distance in W 1 . Therefore the manifold learning problem 
reduces mathematically to the localization problem whereby the distance 'measurements' are dij = 
Win ~ yj\\w N i while the actual distances are dij = dMiViiVj)- The accuracy of these estimates 
depends on the curvature of the manifold M . Let ro = ro (M ) be the minimum radius of curvature 
defined by: 

- = max{||7(t)||}, 

r i,t 

where 7 varies over all unit-speed geodesies in A4 and t is in the domain of 7. For instance, an 
Euclidean sphere of radius ro has minimum radius of curvature equal to ro. 

As shown in f5] (Lemma 3), (1 — dfJlArfydij < d^ < d{j. Therefore, \zij\ oc d\Jr\, and 



A oc r /Vq. Theorem 1.1 supports the claim that the estimation error d(X,X) is bounded by 

C(nr d ) 5 /rl 

As mentioned several times, this paper focuses on a particularly simple SDP relaxation, and 
noise model. This opens the way to a number of interesting directions: 

1. Stochastic noise models. A somewhat complementary direction to the one taken here would 
be to assume that the distance measurements are <i?- = dfj + 2y with {z-ij} a collection of 
independent zero-mean random variables. This would be a good model, for instance, for 
errors in RSSI measurements. 

Another interesting case would be the one in which a small subset of measurements are grossly 
incorrect (e.g. due to node malfunctioning, obstacles, etc.). 

2. Tighter convex relaxations. The relaxation considered here is particularly simple, and can 
be improved in several ways. For instance, in manifold learning it is useful to maximize the 
embedding variance Tr(Q) under the constraint Qu = [24J. 

Also, for any pair $ E it is possible to add a constraint of the form (My, Q) < dfp where 

dij is an upper bound on the distance obtained by computing the shortest path between i 
and j in G. 

3. More general geometric problems. The present paper analyzes the problem of reconstructing 
the geometry of a cloud of points from incomplete and inaccurate measurements of the points 
local geometry. From this point of view, a number of interesting extensions can be explored. 
For instance, instead of distances, it might be possible to measure angles between edges in 
the graph G (indeed in sensor networks, angles of arrival might be available \17\ I15|). 



4 Proof of Theorem 1.1 (Upper Bound) 

Let V = (u, x^ l \ • • • , x^) and for any matrix S G M nxn , define 
S = P v SP v + P v SPJf + P^SP v , s 1 - 



pjsp 



v ■ 



(8) 



Thus S = S + S- 1 . Also, denote by R the difference between the optimum solution Q and the 
actual Gram matrix Qo, i.e., R = Q — Qo- The proof of Theorem |1.1| is based on the following key 
lemmas that bound R 1 - and R separately. 
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Lemma 4.1. There exists a numerical constant C = C{d), such that, w.h.p., 

1^11* < C^{nr d fA. (9) 



r' 



Lemma 4.2. There exists a numerical constant C = C(d), such that, w.h.p., 



2 



\R\\i < C'-^{nr d ) 5 A. (10) 



We defer the proof of lemmas |4.1| and 4.2 to the next section. 

Proof ( Theorem ] Op . Let Q = Y^l=\ °~i u i u I > where \\ui\\ = 1, ufiij = for i / j and o\ > o~2 > 
• • • > ff n > 0. Let Vd(Q) = Yli=i °~i u i u T be the best rank-c? approximation of Q in Frobenius 
norm (step 2 in the algorithm). Recall that Qu = 0, because Q minimizes Tr(Q). Consequently, 
Pd(Q)u = and Vd(Q) = LT J d (Q)L. Further, by our assumption Qqu = and thus Qo = LQqL. 
Using triangle inequality, 

\\LV d (Q)L - LQ L\\i = \\V d (Q) - Q ||i 

<\\Vd(Q)-Q\h + \\Q-Qo\h- (ii) 

Observe that, Q = Qo + R and Q 1 - = R 1 '. Since Vd(Q) — Q has rank at most 3d, it follows that 
\\Pd{Q) - Qlli < n\\V d {Q) - Q\\ F < V3dn\\V d (Q) - Q\\ 2 (for any matrix A, \\Af F < i a nk(A)\\Ag). 
By triangle inequality, we have 

\\V d (Q) - Qh < WMQ) - Qh + \\Q_^Qh. (12) 

Note that \\Vd(Q) — Qh = o- d+ \. Recall the variational principle for the eigenvalues. 

o~„ = min max y T Qy. 

H,dim(H)=n-q+ly£H,\\y\\ = l 

Taking H = (xW, • • • , x^)- 1 , for any y G H, y T Qy = y T PyQPyy = y T Q ± y = y T R ± y, where we 
used the fact Qu = in the first equality. Therefore, a d+ i < maxy^n^ y 1 R ± y = \\R h It follows 
from Eqs. (11) and (12) that 



\\LV d (Q)L - LQqLWx < 2V3dnp- L || 2 + 



Using Lemma 4.1 and 4.2, we obtain 



d(X,X) = ^\\LV d {Q)L - LQqL\\ x < C{nr d f^, 

which proves the claimed upper bound on the error. 

The lower bound is proved in Section [7j □ 
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5 Proof of Lemma 14.1 



The proof is based on the following three steps: (i) Upper bound H-R^H* in terms of cr m i n (f2) and 
(T max (n), where Q is an arbitrary positive semidefinite (PSD) stress matrix of rank n — d—1 for the 
framework; (ii) Construct a particular PSD stress matrix f2 of rank n — d — 1 for the framework; 
(Hi) Upper bound <7 max (f2) and lower bound <7 mm (^). 

Theorem 5.1. Let £1 be an arbitrary PSD stress matrix for the framework Gx such that rank(O) = 
n — d — 1 . Then, 

\\R L \U <2 (Jmax( ^V |A. (13) 



Proof Note that R 1 = Q L = P^QP^f h 0. Write R 1 - = E™"/ -1 A;U;uf, where ||u<|| = 1, 
ufuj = for i ^ j and Ai > A2 > • • • X n -d-i > 0. Therefore, 

n—d—1 n—d—1 

{Sl,R L ) = {Sl, Ai^nf)= KuJnui^a^WWR 1 ^. (14) 

i=l i=l 

Here, we used the fact that Ui 6 V 1 - = Ker _L (r2). Note that cr mm (^) > 0, since fl y 0. 

Now, we need to upper bound the quantity R- 1 -). Since flu = 0, the stress matrix Q, = [ujij] 
can be written as O = Y^a ^ge^v^j- Define w max = maxl^l. Then, 

(£l,R ± ) = (U,R) = ^ UijiM&R) 

< Yl ^maxKMy.Q- Q }\ 
(m)g£ 

< Y w ma X (|(M i: ,-, Q) - dij 2 \ + I dij 2 - dfj I) 

(m)6£ ' r ' 

< 2w max |£|A, (15) 
where (o) follows from the fact that (Py,f2) = 0. Since Q >z 0, we have uifj < oouojjj 



(ej Qei)(ej Qej) < CT max (^), for 1 < i,j < n. Hence, w max < CT max (0). Combining Eqs. ([14) 
and (15), we get the desired result. □ 

Next step is constructing a PSD stress matrix of rank n — d — 1. For each node i S V(G) define 
d = {j £ V(G) : dij < r/2}. Note that the nodes in each C% form a clique in G. In addition, let Si 
be the following set of cliques. 

Si := U {d\k} U {d}. 

Therefore, Si is a set of \Ci\ + 1 cliques. For the graph G, we define cliq(G) := Si U • • • U S n . 
Next lemma establishes a simple property of cliques Cj. Its proof is immediate and deferred to 
Appendix [B] 

Proposition 5.1. If r > 4c\' r d(logn/n) 1 / d with c > 1, the following is true w.h.p.. For any two 

nodes i and j , such that \\ || < r/2, \CiC\Cj\ >d + l. 
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Now we are ready to construct a special stress matrix of Gx- Define the \Qk\ x \Qk\ matrix 



fit. as follows. 



n k = p a 



I (1) (d)\- 

\ u Q k < x Q k <"' ' x Q k ' 

Let f2/t be the n x n matrix obtained from by padding it with zeros. Define 



o= ^ n fc . 

Q fc ecliq(G) 

The proof of the next statement is again immediate and discussed in Appendix [Cj 

Proposition 5.2. The matrix £1 defined above is a positive semidefinite (PSD) stress matrix for 
the framework Gx- Further, almost surely, rank(fi) = n — d — 1. 

Final step is to upper bound cr max (0) and lower bound <7 mm (f2). 
Claim 5.1. There exists a constant C = C{d), such that, w.h.p., 

%ax(fi) < C{nr d f. 

Proof. For any vector v G M n , 



v T n v = Yl vT & k v= E \\&kv\\ 2 = E n p ( 

Q fc ecliq(G) Q fc ecliq(G) S fc ecliq(G) 



< E n«aJ a = £«? E i = E(E^ih 2 ^(^H) 2 - 

Q fc Gcliq(G) j=l k:j£Q k j = l iGCj 

The last inequality follows from the fact that, w.h.p., \Cj\ < Cnr d for all j and some constant C 
(see Corollary 2.1 ). □ 

We now pass to lower bounding <7 mm (f2). 

Theorem 5.2. There exists a constant C = C(d), such that, w.h.p., il -1- >z C{nr d )~^r 2 . {see 
Eq. m. 



The proof is given in Section 5.1 We are finally in position to prove Lemma |4.1 



Proof (Lemma 4-1 )■ Following Theorem 5.2 and Remark 2.2 we obtain <r m i n (O) > C(nr d y 2 r 4 . 
Also, by Corollary 2.1, w.h.p., the node degrees in G are bounded by 3/2Kdnr d . Hen ce, w.h.p., 
\E\ < 3/ 'An 2 Kdr d . Using the bounds on cx max (S7), a m ™ ffi) and \E\ in Theorem 5.1 yields the 
thesis. □ 



5.1 Proof of Theorem 15.21 

Before turning to the proof, it is worth mentioning that the authors in [5j propose a heuristic 
argument showing Qv ~ C 2 v for smoothly varying vectors v. Since o" mm (£) > C(nr d )r 2 (see 



Remark 2.2), this heuristic supports the claim of the theorem. 



In the following, we first establish some claims and definitions which will be used in the proof. 
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Claim 5.2. There exists a constant C = C(d), such that, w.h.p., 

n 



.1.-, 

k=l 



The argument is closely related to the Markov chain comparison technique [TT]. The proof is 
given in Appendix [Dj 

The next claim provides a concentration result about the number of nodes in the cliques C{. Its 
proof is immediate and deferred to Appendix |E} 

Claim 5.3. For every node i E V(G), define Ci = {j E V(G) : dij < |(| + j^q)}- There exists an 
integer number m such that the following is true w.h.p.. 

\Ci\<m<\Ci\, Vi E V(G). 



Now, for any node i, let i\, ■ ■ ■ i m denote the m-nearest neighbors of that node. Using claim 5.3 
Ci C {ii, • • • , im} C d. Define the set Si as follows. 

Si — • • • ,Cj\i m }. 

Therefore, Si is a set of (m + 1) cliques. Let cliq*(G) = Si U • • • U S n . Note that cliq*(G) C cliq(G). 
Construct the graph G* in the following way. For every element in cliq*(G), there is a corresponding 
vertex in G*. (Thus, |V(G*)| = n(m+l)). Also, for any two nodes i and j, such that < r/2, 

every vertex in V(G*) corresponding to an element in Si is connected to every vertex in V{G*) 
corresponding to an element in Sj. 

Our next claim establishes some properties of the graph G* . For its proof, we refer to Ap- 
pendix |FJ 

Claim 5.4. With high probability, the graph G* has the following properties, 
(i) The degree of each node is bounded by C(nr d ) 2 , for some constant C = C(d). 
(ii) Let C* denote the Laplacian of G* . Then o" m i n (£*) > C(nr d ) 2 r 2 , for some constant C. 



Now, we are in position to prove Theorem 5.2 



Proof (Theorem 5.2). Let v E V be an arbitrary vector. For every clique Qi E cliq(G), de- 
compose v locally as VQ i = Y^=\P^^q. + ^'i u Q l + w ^ % \ where qTq. = P^ x^, and u;W g 

(x^,-- - ,x { ^,u Qi ) L . Hence, 

SiGcliq(G) 

Note that vq^Qj has two representations; One is obtained by restricting VQ i to indices in Qj, and 
the other is obtained by restricting vq. to indices in Qj. From these two representations, we get 



d 

«2U - = - P^Q^ + %^ Qi n Ql ■ (16) 
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Here, Xq^q. = nQ x Q-nQj • ^ ne va l ue °f does not matter to our argument; however it can 
be given explicitly. 



Note that {C t , ■■■ ,C n } C cliq*(G) C cliq(G). Invoking Claim 5.2 



fc=l S l Gcliq*(G) 



^ E ||E^£+- W 

Qi6cliq*(G) «=1 



c ( E || E^ -o, 

,Qiecliq*(G) €=1 



+ E h™' 

Qiecliq*(G) 



II 2 



< C M E E||a 

Q i ecliq*(G) «=1 



E ik 

Qiecliq*(G) 



i i|2 



Hence, we only need to show that 



E |k» || 2 >C(«rVr 2 E E|| A 

Q l ecliq(G) S l ecliq*(G) ^=1 



(17) 



for some constant C = C{d). 

In the following we adopt the convention that for j G V(G*), Qj is the corresponding clique in 
cliq*(G). We have 



Q l ediq(G) 



^)|| 2 > 



E 

GiScliq*(G) 



(a) 



igV^G*) 



GO 

w Q l nQ 1 w Q 1 nQ 1 



> C(nr d )- 2 E (II™ 

(ij)eE(G*) 

> C(nr d )^ 2 E ' U " (i) 

(i,i)e£(G*) 

>c(« r ")- 2 £ ||£(/f-A ! 'H% 

(i,j)&E(G*) £=1 

>C(nr d )-V 2 E E^f"^) 2 - 



(18) 



5.4 



Here, (a) follows from the fact that the degrees of nodes in G* are bounded by C(nr ) (Claim 
part (i)); (b) follows from Eq. (16) and (c) follows from Claim 5.5, whose proof is deferred to 
Appendix [Gj 

Claim 5.5. There exists a constant C = C(d), such that, for any set of values {pf } the following 
holds with high probability. 

||E(/f -/fH'Uf > C(nrV£(/f -Af) 2 , V(i,j) G S(GT). 
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Also note that ||£q^|| 2 < |Qi|r 2 and w.h.p., |Qj| < C(nr d ), for all i G V{G*) (since, w.h.p. 



\C{\ < C{nr ) for all i E V(G) by Corollary 2.1 ). Therefore, using Eq. (18), in order to prove (17) 
it suffices to show that 

E E (/3f-#) 2 >^ d )-vE E ^ (£) ) 2 . 

<=1 {i,j)EE(G*) 1=1 i£V(G*) 

Define = (^) i6 v ( G*)- Observe that, 

E csf - ft®) 2 = v®) T r(W > vmunwp^w 2 - 

{i,j)eE(G*) 



Using Claim 5.4 (part (ii)) we obtain 



(i,i)e£(G») 

The proof is completed by the following claim, whose proof is given in Appendix |H} □ 

Claim 5.6. There exists a constant C = C(d), such that, the following holds with high probability. 

Consider an arbitrary vector v G V ± with local decompositions VQ i = Ylf=i Pi^&Q. + H u Qi + ■ 
Then, 

E H^^ll 2 > C(nr d )- 3 Y^ »«^» 2 
i=\ l=i 



6 Proof of Lemma 4.2 



Recall that R = P V RP V + PyRPy + PyRPv, and V = (a?W, • • • , x^ d \u). Therefore, there exist 
a matrix Y E IR nxd and a vector a6P such that R = XY T + YX T + ua T + au T . We can further 
assume that Y T u = 0. Otherwise, define Y = Y — u(ii T Y/ ||u|| 2 ) and a = a + X(Y T, u/||u|| 2 ). Then 
£ = XY T + YX T + ua T + du T , and Y T ti = 0. 

Also note that, u T Qu = u T Ru = 2(a T ti)||u|| 2 . Hence, a T u = 0, since Qu = 0. In addition, 
Qu = Ru = a\\u\\ 2 , which implies that a = 0. Therefore, R = AY T + YX T where Y T u = 0. 
Denote by yf G M d , i G [n], the i*' 1 row of the matrix Y. 

Define the operator 7£ Gi x : M nxd -»• M £ as 7£g,x(Y) = R G (X)y, where = [yf, • • ■ ,2/I] T and 
Rg{X) is the rigidity matrix of framework Gjf- Observe that 

||^g,x(Y)||i = E |(a:/-x fc)M -y fc )|. 

(l,k)EE(G) 

The following theorem compares the operators TZg,x and TZx n ,x, where G = G(n,r) and is 



the complete graph with n vertices. This theorem is the key ingredient in the proof of Lemma 4.2 
Theorem 6.1. There exists a constant C = C(d), such that, w.h.p., 

\\Tl Kn ,x(Y)\\i < Cr- d - 2 \\n G , x (Y)\\i, for all Y G R nxd . 
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Proof of Theorem 6.1 is discussed in next subsection. The next statement provides an upper 
bound on Its proof is immediate and discussed in Appendix [ij 

Proposition 6.1. Given R = XY T + YX T , with Y T u = 0, we have 

\\R\\i<mK n ,x(Y)h- 



Now we have in place all we need to prove lemma 4.2 



Proof (Lemma J^.2). Define the operator A G '■ M. nxn 
assumptions, 



as Ag{S) = [{Mij,S))(i^ eE . By our 



\{M i3 ,R) + {Mij,R L )\ = \(Mij,Q) - (Mij,Q )\ 
< \(Mij,Q) - d%\ + \d% - (Mij,Q )\ < 2A. 

V * ' 

\ z ij\ 

Therefore, ||A?(#)||i < 2\E\A + WAaiR 1 )^. Write the Laplacian matrix C as C = E(ij)e£ M v- 
Then, (C^^) = E(i,j)ei?( M *i> R± ) = \\Ag(. r± )\\i- Here > we used the fact that (M^R 1 ) > 0, 
since M {j y and R 1 - y 0. Hence, p G (^)||i < 2|£|A + (A-R" 1 }- Due to Theorem [Kgl Eq. gBb, 



and Claim 5.1 



< C(nr d ) 3 r~ 2 (fi,i? x ) < C(nr d f^A 



ri 



whence we obtain 



HA^IIi <C(nr c 



) 6 ^A. 



The last step is to write ||^4 G (i?)||i more explicitly. Notice that, 

\\A G (R)h= Y, \{M ik ,XY T + YX T )\ = 2 £ \(x t - x k , yi - y k )\ = 2\\K G , X (Y)\\ 1 . 

(l,k)£E (l,k)eE 



Invoking Theorem 6.1 and Proposition |6,1[ we have 

Pill < Cr- d - 2 \\K G , x (Y)\\, 



Cr~ 



'\\AG{R)\\i<C{nr 



□ 



6.1 Proof of Theorem 16.11 

We begin with some definitions and initial setup. 

Definition 1. The d- dimensional hypercube is the simple graph whose vertices are the <i-tuples 
with entries in {0, 1} and whose edges are the pairs of c?-tuples that differ in exactly one position. 

(2) 

Also, we use M\ to denote the graph with the same set of vertices as M^, whose edges are the 
pairs of d-tuples that differ in at most two positions. 
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Figure 1: An illustration of a chain G 



Definition 2. An isomorphism of graphs G and H is a bijection between the vertex sets of G and 
H, say </> : V(G) —> V(H), such that any two vertices u and v of G are adjacent in G if and only if 
(f>(u) and ^(v) are adjacent in H. The graphs G and are called isomorphic, denoted by G ~ 
if an isomorphism exists between G and if. 

Chains and Force Flows. A chain Gij between nodes i and j is a sequence of subgraphs 
H lt H 2 , ■ ■ ■ , H k of G, such that, H p ~ M^ 2) for 1 < p < jfe, F p n ~ Mf\ for 1 < p < k - 1 
and n -f/p+2 is empty for 1 < p < k — 2. Further, i (resp. j) is connected to all vertices in 
V(Hx) \ V{H 2 ) (resp. V{H k ) \ V(H k - X )). See Fig. [l] for an illustration of a chain in case d = 2. 

A force flow 7 is a collection of chains {Gij}\<i^j< n for all (T) node pairs. Let T be the collection 
of all possible 7. Consider the probability distribution induced on T by selecting the chains between 
all node pairs in the following manner. Chains are chosen independently for different node pairs. 
Consider a particular node pair Let £ = \\x{ — Xj\\ and a = (xi — Xj)/\\xi — Xj\\. Define 

f = and choose nonnegative numbers m G Z and r/ £ E, such that, £ = mf + 7/ and rj < f. 
Consider the following set of points on the line segment between Xi and Xj. 

6c = Xi + — + (k — l)fa, for 1 < k < m + 1. 

Construct the sequence of hypercubes in direction of a, with centers at + £fc + i)/2, and side 
length f. (See Fig. [2] for an illustration). Denote the set of vertices in this construction by {z k }- 
Now, partition the space [— 0.5,0. 5] d into hypercubes (bins) of side length From the proof of 



Proposition 5.1, w.h.p., every bin contains at least one of the nodes {xk}ke[n]- For every vertex 
Zfc, choose a node x k uniformly at random among the nodes in the bin that contains Hence, 
H^fc — Zk\\ < § and 

... r 
|R - Xk\\ < \\xi - zi\\ + \\zi - Zk\\ + \\Zk - x k \\ <- + \\zi - Zk\\, VI, k. 

By wiggling points {z k } to nodes {x k }, we obtain a perturbation of the sequence of hypercubes, 
call it Gij. It is easy to SGG tllclt Gij is a chain between nodes i and j. 
Under the above setup, we claim the following two lemmas. 

Lemma 6.1. Under the probability distribution on T as described above, the expected number of 
chains containing a particular edge is upper bounded by Cr~ d ~ x , w.h.p., where C = C(d) is a 
constant. 

The proof is discussed in Appendix |jj 
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Bin B. 




Figure 2: Construction of chain for case d = 2. 



Lemma 6.2. Let Gij be the chain between nodes i and j as described above. There exists a constant 
C = C{d), such that, 

\(xi- Xj,yi-yj)\<Cr~ l ^ \{xi - x k , y x - y k )\ , Vl<i,j<n. 

(l,k)<=E(G i:i ) 



The proof is deferred to Section 6.1.1 Now, we are in position to prove Theorem 6.1 



Proof (Theorem 6.1). Consider a force flow 7 = {Gij}i<ij< n . Using lemma 6.2 we have 



^2 \(xi - xj,yi - yj)\ < Cr 1 ^ ^ \(x t - x k ,yi - y k )\ 
i,3 i,j {l,k)&E{Gij) 

^ Cr_1 E ( E l)lfa-*k>M-|/fc>l 

(l,k)eE(G) Gij:{l,k)£E{Gij) 

= Cr~ x ^2 b (i,{ l > k ))\( x i- x k,yi-yk}\, 

(l,k)<EE(G) 



(19) 



where 6(7, (I, k)) denotes the number of chains passing through edge (I, k). Notice that in Eq. (19), 
6(7, (/, k)) is the only term that depends on the force flow 7. Hence, 6(7, (I, k)) can be replaced by 
its expectation under a probability distribution on T. According to Lemma [qTT| under the described 
distribution on T, the average number of chains containing any particular edge is upper bounded 
by CV _d_1 , w.h.p. Therefore, 

\( x i ~ x iiVi ~ Vj)\ ^ C r ~ d ~ 2 E \( x i- x k,yi-yk}\- 

i,3 (l,k)eE(G) 



Equivalently, \\n Kn M Y )h < Cr"^ 2 \\Tl Gi x{Y)\\x, with high probability. 



□ 
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6.1.1 Proof of Lemma EH 

Proof. Assume that | V(G f i J -)| = m + 1 . Relabel the vertices in the chain G%j such that the nodes 
i and j have labels and m respectively, and all the other nodes are labeled in {1, ••■ ,m — 1}. 
Since both sides of the desired inequality are invariant to translations, without loss of generality 
we assume that xq = y§ = 0. For a fixed vector y m consider the following optimization problem: 



©= min y~) \(xi-x k ,yi-y k )\. 



To each edge (I, k) £ E(Gij), assign a number X[ k . (Note that Xi k = X k i). For any assignment with 
m ax(i,fc)eB(G y ) \kk\ < 1, we have 



@> min y~] Xik{xi-x k ,yi-y k ) 

min } } \ik{yi,xi - x k ) 



J/1, ••• ,2/m-l 



/eGij fceaz 



3/1, ■■■ ,2/m-l 



mm (yz> ^fe(^ - »fe))> 

GGij feed* 



where dl denotes the set of adjacent vertices to I in Gij. Therefore, 



9> max min V" (y t , } \ik(xi - (20) 

A ife :|A ;fc |<l 2/i,- >2 / m _ir ro " ^ / — ' 



Note that the numbers A/fc that maximize the right hand side should satisfy Ylkedi X[ k (xi — x k ) 
0, V7 / 0,m. Thus, 6 > {ym,J2kedm X 

mk(%m %k))- Assume that we find values \i k such that 



Ylk&di kk{xi - x k ) = V7/0,m, 

J2kedm ^mk(Xrn ~ X k ) = X m , (21) 
•lk\ 



max lA/tl < Cr . 



U«,fc)eS(Gy) 

Given these values A^, define Xi k = — — - — r. Then |A^| < 1 and 

max A/fc 

(l,k)eE(Gij) 

© > (i/m; / y ^mk{ x m~X k )) = (y m , rr :X m ) > Cr(y m ,X Tn ), 

.~ max/ fc A/fc 

k£om ' 

which proves the thesis. 



Notice that for any values Xi k satisfying (21), we have 

J Sjgy(Gy) Sfceaz A Zfc( x z _ x /«) = Sfceao ^ofcC^o - x k ) + x m 

\ J2l£V(G l3) J2kedl X lk{xi - X k ) = E(Z,fe) 6 E(Gy) A 'fcO« - x fc) + X k i(x k -xi)=0 
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Hence, J2kedo ^0k(%0 ~ Xk) = -x m - 

It is convenient to generalize the constraints in Eq. (21). Consider the following linear system 
of equations with unknown variables Xik- 



^ ^lk( x l - x k ) =ui, for I = 0, • • • , m. 

k&dl 



(22) 



Writing Eq. (22) in terms of the rigidity matrix of Gij, and using the characterization of its null 
space as discussed in section 2.1, it follows that Eq. (22) have a solution if and only if 

m m 
^2 u i = 0) ^ U f Ax i = °> 



(23) 



i=0 



i=0 



where A S M. dxd is an arbitrary anti-symmetric matrix. 

A mechanical interpretation. For any pair (I, k) £ E(G{j), assume a spring with spring constant 
Xik between nodes I and k. Then, by Eq. (22), ui will be the force imposed on node /. The first 
constraint in Eq. (23) states that the net force on Gij is zero (force equilibrium), while the second 
condition states that the net torque is zero (torque equilibrium). 



^ Indeed, YT=o u i Au * = (A YT=a u i x i) = 
Y^JILq u i x f is a symmetric matrix. Therefore, 



0, for every anti-symmetric matrix A if and only if 



^ a xj 

8=0 



i=0 \£=1 / 



Me 



(k) 

x) 'e k 



Y^ ) x?-x { P^ ) )(e^e k ) = ^ 



\k=l 



e,k i=o 



With this interpretation in mind, we propose a two-part procedure to find the spring constants 
Xik that obey the constraints in (21). 

Part (i): For the sake of simplicity, we focus here on the special case d = 2. The general 
argument proceeds along the same lines and is deferred to Appendix [Kj 

Consider the chain G^ between nodes i and j, cf. Fig. [lj For every 1 < p < k, let T v denote 
the common side of H p and H p+ \. Without loss of generality, assume V(F P ) = {1, 2}, and x m is in 
the direction of e\. Find the forces f\, f2 such that 



/1 + /2 



fi A xi + f 2 A x 2 = 0, 



||/i|| 2 + ||/ 2 || 2 <C7||x m || 2 . 
To this end, we solve the following optimization problem. 

minimize ^(||/i|| 2 + H/2II 2 ) 
subject to fi + / 2 = x m , /iAii + / 2 Ai2 = 
It is easy to see that the solutions of p5] ) are given by 

J/i = \x m + ljA(xi - x 2 ) 

\/2 = \x m - 37^(^1 - X 2 ) 

7 = -TTZ — u-) x m A (x\ + x 2 ), A 



(24) 



(25) 



\xi - x 2 \ 



-1 

1 
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Now, we should show that the forces /i and f 2 satisfy the constraint ||/i|| 2 + H/2II 2 < C\\x 
for some constant C. Clearly, it suffices to prove ||7(xi — ^2) [| < C||x m ||. Observe that 



2 

m|| ; 



h{x\ -x 2 ) 



1 



\Xl - x 2 \ 

1 

\xi - x 2 \ 

1 

\x\ - x 2 \ 



rA{xi + x 2 ) 



\ej A(x\ + x 2 ) 
|ef (x\ + x 2 )\. 



From the construction of chain Gij, we have 



\e2 (xi + x 2 )\ < -, — a; 2 [| > 

which shows that ||7(xi — 3^2) || < H^mll- 

Part (ii): For each H p consider the following set of forces 



-fi ifieHVi} 



(26) 



Also, let uq = —x m and u m = x m . (cf. Fig. [3j 



Notice that YjieV(H ) u i = J2ieV{H ) u i^ x i = Oj an d thus by the discussion prior to Eq. (23), 



( H ) 

there exist values \ lk , such that 



\\r\xi-x k ) = u u VleV(H p ). 

k:(l,k)eE(H p ) 

Writing this in terms of R^ Hp \ the rigidity matrix of H p , we have 



u. 



(27) 



where the vector A^ p ^ = [A,. p ] has size \E(H P )\ = d(d + l)2 d_2 , and the vector u = [u{\ has size 
d x |U(-ff p )| = d2 d . Among the solutions of Eq. (27), choose the one that is orthogonal to the 
nullspace of (R^ Hp ^) T . Therefore, 

^minCR^IIA^IU < a min (i?^))||A^|| 2 < ||n|| < C\\x m \\. 

Form the construction of the chains, H p is a perturbation of the d-dimensional hypercube with 
side length r = (each vertex wiggles by at most |). Using the fact that 0" m in(-) is a Lipschitz 

continuos function of its argument, W6 get ttlclt CT min 

(R{H P )) > Cr, for some constant C = C(d). 

Also, ||x m || < 1. Hence, ||A^||oo < Cr -1 . 
Now define 



A 



Ik 



Hk ' 



V(l,k) G E(Gi 



(28) 



H p :(l,k)€E(H p ) 



We claim that the values Xik satisfy the constraints in (21). 
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u, =-/. < 



w i 4 = -A < — 




— > h = A 



> u k = f h 



Figure 3: H p and the set of forces in Part (ii) 



First, note that for every node I, 



^2 \ lk (xt -x k ) = l Yj Ak p) ) ( x i - x k) 

k&dl k&dl \H p :(l,k)EE(H p ) ) 

= E ( E Ak p \*i-* k ) 

H p :l&V(H p ) \k:(l,k)eE(H p ) 

= E Ul ' 

H p :l£V(H p ) 



(29) 



For nodes I ^ {0, m}, there are two H p containing I. In one of them, ui = fi and in the other 
ui = — fi. Hence, the forces ui cancel each other in Eq. (29) and the sum is zero. At nodes and 
to, this sum is equal to — x m and x m respectively. 



Second, since each edge participates in at most two H p , it follows from Eq. (28) that |A^| < 



Cr~ 



□ 



7 Proof of Theorem 1.1 (Lower Bound) 

Proof. Consider the 'bending' map T : [—0.5, 0.5] rf — > W i+1 , defined as 

T(h,t 2 , • • • ,t d ) = (Rsmj^,t 2 , ■ ■ ■ ,t d ,R{l - cos ^)) 

This map bends the hypercube in the d + 1 dimensional space. Here, R is the curvature radius of 
the embedding (for instance, R S> 1 corresponds to slightly bending the hypercube, cf. Fig. [4]). 

Now for a given A, let R = max{l, r 2 A~ 1//2 } and give the distances dij = \\T(xi) — T(xj)\\ as the 
input distance measurements to the algorithm. First we show that these adversarial measurements 
satisfy the noise constraint ||d 2 - — dfj\\ < A. 
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Figure 4: Bending map T, with R — 2, and d = 2. 



4 



4 



# 2 



(i) 



cos 



< 



■ 



4 1} ) 2 

T (l) 

„M\2 



sin 



r (i) 
i2 



sin 



R 



cos 



R 



2 cos 



_ _(1) 



2R? 



< 



2R 2 



< A. 



\dl-dl\<A. 



Also, djj < djj . Therefore, \zy , 

The crucial point is that the SDP in the first step of the algorithm is oblivious of dimension 
d. Therefore, given the measurements dij as the input, the SDP will return the Gram matrix Q 



of the positions Xi = LT(xi), i.e., Qi 



Denote by {u\, ■ ■ ■ ,Ud}, the eigenvectors of Q 



corresponding to the d largest eigenvalues. Next, the algorithm projects the positions {^i}ie[ n i 
the space U = (u\, • • • , ua) and returns them as the estimated positions in K d . Hence, 



onto 



d(X,X) 



1 



\\XX T - P v XX T Pi 



c/IU- 



Let W = (ei, &2i ■ ■ ■ , e-d) ( see Fig. [5]). Then, 



1 



d(X, X)>^r \\XX T - XP W X 



XP\yX T — PjjXX^ P] 



ri- 



ll* 



U\\l- 



(30) 
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Figure 5: An illustration of subspaces U and W. 



We bound each terms on the right hand side separately. For the first term, 
f 



\\XX T -XPwX 1 )^ 



1 



n- 



E 

l<i,j'<n 



x m x m 



(a) 1 



n- 



E 

X<i,j<n 
2 



x {1) 

R' S i n ( ±i_ 
R 

(i) 



sm 



(i) 



(^ (1) ) 3 + £ 



T (i) 



E 



1 



3!V R 



SIR 3 5!i? 5 A R 
1 /x 



3!i? 3 5!,R 5 



+ 



3!V R 



x i_\ 
R J 



> 



C 



{nRf 



E 

l<i<n 



„(1) 



2 

i<i<« 



(1)|3 



> 



^2' 



(31) 



where (a) follows from Taylor's theorem, and (b) follows from \ii/R\ < \xi/R\ < 1/2. 

The next Proposition provides an upper bound for the second term on the right hand side of 
Eq. (30)| . 

Proposition 7.1. TTte following is true. 

1 



||XP W X T - PuXXTPuWi a.s., as n -»■ oo. 



Proof of this Proposition is provided in the next section. 

Using the bounds given by Proposition 7.1 and Eq. (31), we obtain that, w.h.p., 

d(X,X)>~>Cmin{l,~}. 



The result follows. 



□ 
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7.1 Proof of Proposition [77T 



We first establish the following remarks. 

Remark 7.1. Let a, b £ M m be two unitary vectors. Then, 

||aa T -66 r || 2 = y/l - [any. 
For proof, we refer to Appendix [L~| 

Remark 7.2. Assume A and A are pxp matrices. Let {Aj} be the eigenvalues of A such that Ai > 
• • • > Ap-i > A p . Also, let v and u respectively denote the eigenvectors of A and A corresponding 
to their smallest eigenvalues. Then, 

T~x2 ^ 4||A - A|| 2 



1 - (v 1 vf < 



Ap— i — A p 



The proof is deferred to Appendix [M} 



Proof (Proposition 7.1). Let X = 5Zi=i o~iUiwf be the singular value decomposition of X, where 
ll n «ll = ll^ill = 1) n ? e ^\ e and a\ > <r 2 > • • • > cr d+1 . Notice that 

PuX = ^o-iUiwf = (^aiUiwf)(^2wjwj) = XP W , 

i=l i=l j=l 

where W = {m,--- ,w d ), and P w £ E( d +l)x( d + 1 ). Hence, P V XX T P V = AP^1 T . Define M = 
P w — Pw- Then, we have 

-^\\XP W X T - PuXX^PuWx = -^||XMX T ||i = ^ Yl \^Mxj\ 



l<i ,j<n 

< ^\\M\\ 2 INIINI < ll M l|2- (32) 



n 

l<i,j<n 

Now, we need to bound 1 1 1 1 2 - We have, 

M = P W -P W = (I- P„ d+ J - (I — P ed+1 ) = Pe d+1 ~ Pu, d+1 - 

Using Remark 7.1 we obtain ||M|| 2 = ||e d+1 ej +1 - w d+1 wj +1 || 2 = yjl - (e^ +l w d+l ) 2 . 

Let Zi = 5hx( e R^+^x^+i), Z = \Xd=\ Z i and Z = E(Zi). Notice that Z = \X T X = 
n Si=i °f '&iwf . Therefore, u^+i is the eigenvector of Z corresponding to its smallest eigenvalue. 
In addition, Z is a diagonal matrix (with the smallest diagonal entry). Hence, ed+i is 

its eigenvector corresponding to the smallest eigenvalue, Z^+i^d+i)- 

By applying Remark |7.2[ we have 



\Mh<^-(e^ d+1 f<Jf^, (33) 
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where A^ > A^+i are the two smallest eigenvalues of Z. Let t be a random variable, uniformly 
distributed in [—0.5,0.5]. Then, 



E 



R 2 sin 2 



R 



and Arf + i = E 



R 2 1 



cos 



Hence, X d - \ d+1 = R 3 {-l/R - sin(l/R) + 4sin(l/2E)) > 0.07, since R > 1. 

Also, note that {Zi}i<i< n is a sequence of iid random matrices with dimension {d + 1) and 
||.Z||oo = ||IE(^i)||oo < oo. By Law of large numbers, Z — > Z, almost surely. Now, since the operator 
norm is a continuos function, we have \\Z — Z\i — > 0, almost surely. The result follows directly 



from Eqs. (32) and (33). 



□ 



8 Numerical experiments 

Theorem 



1.1 



considers a worst case model for the measurement noise in which the errors {zij}(i,j)eE 
are arbitrary but uniformly bounded as \zij\ < A. The proof of the lower bound (cf. Section [7| 
introduces errors {%'}(ij)eB defined based on a bending map, T. This set of errors results in the 
claimed lower bound. For clarity, we denote this set of errors by {z]j}. In this section, we consider 
a mixture model for the measurement errors. For given parameters A and e, we let 

~£7A/2 + (34) 



where "fa( x ) = l/(v / 27ro")e~ :c l 2a is the density function of the normal distribution with mean zero 
and variance a 2 . The goal of the numerical experiments is to show the dependency of the algorithm 
performance on each of the parameters n, r and A. We consider the following configurations. For 
each configuration we run the SDP-based algorithm and evaluate d(X, X). The error bars in figures 
correspond to 10 realizations of that configuration. Throughout the measurement errors are defined 



according to (34) with e = 0.1. 

1. Fix A = 0.005 and d G {2,4}. Let r = 3(logn/n) 1 / d , with n E {100, 120, 140, • • • ,300}. Fig.[(j] 
summarizes the results. According to the plot, d{X, X) oc n 2 for d = 2 and d(X,X) oc n for 
d = 4. 

2. Fix A = 0.005, d = 2 and n = 150. Let r G {0.5, 0.55, 0.6, • • • , 0.8}. The results are shown in 
Fig. [7| As we see, d(X,X) is fairly proportional to r -4 . 

3. Fix n = 150, r = 0.6 and d = 2. Let A G {0.005,0.01,0.015,0.02,0.025}. Fig. [8] showcases 
the results. The performance deteriorates linearly with respect to A. 
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Figure 6: Performance results for A = 0.005, d — 2,4, and r = 3 (log n/n) 1 / d . The plot shows log d(X, X) 
vs. log n for a set of values of n. The solid line and the dashed line respectively correspond to d(X, X) oc n 2 
and d{X, X) oc n and are plotted as reference. 
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Figure 7: Performance results for A = 0.005, d = 2, and n = 150. The plot shows log d(X, X) vs. log?* for 
a set of values of r. The solid line corresponds to d(X, X) oc r~ 4 and is plotted as reference. 
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Figure 8: Performance results for n = 150, r = 0.6, and d = 2. The plot shows log d(X, X) vs. log A for a 
set of values of A. The solid line corresponds to d{X,X) oc A and is plotted as reference. 



A Proof of Remark 2.1 



For 1 < j < n, let random variable Zj be 1 if node j is in region 1Z and otherwise. The variables 
{zj} are i.i.d. Bernoulli with probability V(1Z) of success. Also, n(lZ) = Y^=x z j- 
By application of the Chernoff bound we obtain 

zj - nV(K) I > 5nV{U) \ > 2 exp 1 

3=1 



/ 2c log Tl 

Choosing 5 = y V(1Z) ' ^ 6 nan< ^ s ^ e becomes 2exp(— clogn) = 2/n c . Therefore, with 

probability at least 1 — 2/n c , 

n(K) £ nV(K) + [-^2cnV{K) logn, y/2cnV(K) logn]. (35) 



B Proof of Proposition 5.1 



We apply the bin-covering technique. Cover the space [-0.5, 0.5] d with a set of non-overlapping 
hypercubes (bins) whose side lengths are 5. Thus, there are a total of m = \l/5~\ d bins, each of 
volume 5 d . In formula, bin (ji, • • • ,jd) is the hypercube — 1)5, j\5) x • • • x [(jd — 1)5, jd,S), for 
jk £ {1, • • • , [1/(51} an d k 6 {1, • • • , d}. Denote the set of bins by {-£>fc}i<fc< m . Assume n nodes 
are deployed uniformly at random in [—0.5, 0.5] d . We claim that if 5 > (clog n/n) l l d , where c > 1, 
then w.h.p., every bin contains at least d + 1 nodes. 
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Fix k and let random variable £j be 1 if node I is in bin Bk and otherwise. The variables 
{C/}l<Kn are i-i.d. Bernoulli with probability 1/m of success. Also £ = X^ILi 6 is the number 
of nodes in bin Bk- By Markov inequality, P(£ < d) < E{Z^~ d }, for any < Z < 1. Choosing 
Z = md/n, we have 



< d) < E{Z^ d } = Z~ d ~[[E{Zt 1 } 



Z~ 



l=i 

m m 



< (™) d e -n/m 
\mdJ 



ne5 c 



n \ d ( d 1 

aI 1 + 

md/ \ n m 



■ e _ nSd < /celogn> n 



By applying union bound over all the m bins, we get the desired result. 

Now take 5 = r/(4\/~d). Given that r > Ac\fd(\ogn/n) l / d , for some c > 1, every bin contains 
at least d + 1 nodes, with high probability. Note that for any two nodes Xi,Xj E [— 0.5,0. 5] d with 

— Xj\\ < r/2, the point (xi + xj)/2 (the midpoint of the line segment between X{ and Xj) is 
contained in one of the bins, say B^. For any point s in this bin, 



Xi\\ < 



~t~ Xj 



+ 



2*2 I Xj 



r r r 
<- + - = -. 
_ 4 4 2 



Similarly, ||s — < r/2. Since s € Bk was arbitrary, CiCiCj contains all the nodes in Bk- This 
implies the thesis, since B^ contains at least d + 1 nodes. 



C Proof of Proposition 5.2 



Let rrik = \Qk\ and define the matrix Rk as follows. 



Rk 



„(i) 



„(<*) 



i>(d+l)xmfe 



Compute an orthonormal basis io^i, • • • ,Wk } m k -d-i E M mfc for the nullspace of Rk- Then 



0* 



mfc — d— 1 

£ 

z=i 



Let w)^/ E M n be the vector obtained from u;^ by padding it with zeros. Then, S\ = d 1 ^JM^kV 

In addition, the (i, j) entry of is nonzero only if i, j E Qk- Any two nodes in are connected 
in G (Recall that Qk is a cliques of G). Hence, Clk is zero outside E. Since £1 = 5Z^Q fc ediq(G) 
the matrix f2 is also zero outside E. 

Notice that for any v E (x^, ■ ■ ■ , x^ d \u), 



Q fc ecliq(G) 



0fcU s fc = °- 

Sfcecliq(G) 
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So far we have proved that 0, is a stress matrix for the framework. Clearly, £1 y 0, since £lk y 
for all fc. We only need to show that rank(O) = n — d — 1. Since Ker(S7) 5 (a? , ■ • • ,x^,u), we 
have rank(J7) < n — d — 1. Define 

Q fe e{Ci,-,C n } 

Since Q. y O ^ 0, it suffices to show that rank(f2) > n — d — 1. For an arbitrary vector v G Ker(fJ), 
which implies that u c . G (u c . , Xq) , ■ ■ ■ ,x^). Hence, the vector v c ^ can be written as 

» Ci =E4"4?+/'r i, «c 

£=1 

for some scalars /3- . Note that for any two nodes i and j, the vector v c . nC . has the following two 
representations 

d d 



^nc, - 2^ Pi ^nc, + Pi ^nc^ - 2^ Pj x c l nc J + Pj ^nc,- 



Therefore, 

d 



- f>r )4:u + or +1) - ^ +1 > CinCj = o (36) 



=1 



According to Proposition 5.1 with high probability, for any two nodes i and j with \\xi — xA\ < r/2, 



we have |CiDCj| > Thus, the vectors s^nC ' u CiC\Cji ^ — ^ — d are fi near b/ independent, since 

the configuration is generic. More specifically, let Y be the matrix with d+1 columns {x^nc }$=i> 
u dr\Cj- Then, det(Y T Y) is a nonzero polynomial in the coordinates xj^, k G Cj n Cj with integer 
coefficients. Since the configuration of the points is generic, det(Y T Y) 7^ yielding the linear 



independence of the columns of Y. Consequently, Eq. (36) implies that = (5 - f° r an y t wo 
adjacent nodes in G(n,r/2). Given that r > 10\/<i(log n/n) 1 ^, the graph G(n,r/2) is connected 
w.h.p. and thus the coefficients m are the same for all i. Dropping subscript (i), we obtain 



d 

V 



J2P {i) xW+^ d+ %, 
proving that Ker(f2) C (u, • • • , i"), and thus rank(J7) > n — d — 1. 
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D Proof of Claim O 



Let G = (V, E), where E = : dij < r/2}. The Laplacian of G is denoted by C. We first show 

that for some constant C, 

n 

C^CJ2Pu c - (37) 



Note that, 



-k 

k=l 



n 



k=i k=i 1 Kl k=i 1 Kl i,j&c k 

*= E ( E ET|)*«- E ( E 



The inequality follows from the fact that My >: 0, Vi, j. By application of Remark 2.1, we have 
|Cfc| < C\{nr d ) and |C, DCj| > C>znr d , for some constants Ci and C2 (depending on d) and Vk,i,j. 
Therefore, 

Next we prove that for some constant C, 

C H CX. (38) 

To this end, we use the Markov chain comparison technique. 

A path between two nodes i and j, denoted by 7^, is a sequence of nodes (i,vi,-— ,v t -i,j), 
such that the consecutive pairs are connected in G. Let 7 = (Tij ) (i ,j)e£ denote a collection of paths 
for all pairs connected in G, and let T be the collection of all possible 7. Consider the probability 
distribution induced on T by choosing paths between all connected pairs in G in the following way. 

Cover the space [— 0.5,0. 5] d with bins of side length r/(4y/d) (similar to the proof of Propo- 
sition 5.1 As discussed there, w.h.p., every bin contains at least one node). Paths are selected 
independently for different node pairs. Consider a particular pair connected in G. Select 7^ 
as follows. If i and j are in the same bin or in the neighboring bins then 7^ = Otherwise, 
consider all bins intersecting the line joining i and j. From each of these bins, choose a node v k 
uniformly at random. Then the path 7^ is (i,v\, ■ ■ ■ 

In the following, we compute the average number of paths passing through each edge in E. The 
total number of paths is \E\ = @(n 2 r d ). Also, since any connected pair in G are within distance 
r of each other and the side length of the bins is 0(r), there are O(l) bins intersecting a straight 
line joining a pair £ E. Consequently, each path contains 0(1) edges. The total number of 
bins is Q(r~ d ). Hence, by symmetry, the number of paths passing through each bin is Q(n 2 r 2d ). 
Consider a particular bin B and the paths passing through it. All these paths are equally likely 
to choose any of the nodes in B. Therefore, the average number of paths containing a particular 
node in B, say i, is Q(n 2 r 2d /nr d ) = Q(nr d ). In addition, the average number of edges between i 
and neighboring bins is Q(nr d ). Due to symmetry, the average number of paths containing an edge 
incident on i is 0(1). Since this is true for all nodes i, the average number of paths containing an 
edge is 0(1). 
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Now, let v G W 1 be an arbitrary vector. For a directed edge e G E from i — >• j, define 
u(e) = V{ — Vj. Also, let |7y| denote the length of the path 7^. 

2 



v Lv 



= E (*-«;) 3 = E (E^))' 

< E i^iE^ e ) 2 = E w ( e ) 2 Ei^i 

< 7* E w ( e ) 26 ( 7 ' e )' 



(39) 



where 7* is the maximum path lengths and 6(7, e) denotes the number of paths passing through e 
under 7 = (jij). The first inequality follows from the Cauchy-Schwartz inequality. Since all paths 
have length 0(1), we have 7* = O(l). Also, note that in Eq. ( p9| ), 6(7, e) is the only term that 
depends on the paths. Therefore, we can replace 6(7, e) with its expectation under the distribution 
on T, i.e., 6(e) = X^er E"(7)&(7> e )- We proved above that the average number of paths passing 
through an edge is 0(1). Hence, max 6(7, e) = 0(1). using these bounds in Eq. (39), we obtain 



v T Cv <C^ v{ef = Cv T Cv, 



(40) 



for some constant C and all vectors v G W 1 . Combining Eqs. (37) and (40) implies the thesis. 



E Proof of Claim 5.3 



In Remark 2.1 let region 1Z be the r/2-neighborhood of node i, and take c = 2. Then, with 
probability at least 1 — 2/ra 2 , 

\Ci\ G np d + [-y^rapd logn, \J Anp A log n], (41) 

where = K d (r/2) d . Similarly, with probability at least 1 — 2/n 2 , 

G np d + [-y/4np d logra, log n], (42) 



where = + TOo) rf - By applying union bound over all 1 < % < n, Eqs. (41) and ( [42 



hold for any i, with probability at least 1 — 4/ra. Given that r > 10\/d(log n/n) <* , the result follows 
after some algebraic manipulations. 



F Proof of Claim 15.4 



Part (i): Let G = (V,E), where E = : c% < r/2}. Also, let and Aq* respectively denote 

the adjacency matrices of the graphs G and G*. Therefore, A & G R nxn and A G * G R NxN , where 
iV = |V(G*)| = n(m + 1). From the definition of G*, we have 



An* = A 



G 



B, B 



1 



(43) 



(m+l)x(m+l) 
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where (g) stands for the Kronecher product. Hence, 

max deg G * (i) = (m + 1) max deg G (i). 

i£V(G*) ieV(G) 

Since the degree of nodes in G are bounded by C(nr d ) for some constant C, and m < C{nr d ) (by 
definition of m in Claim 5.3), we have that the degree of nodes in G* are bounded by C(nr d ) 2 , for 
some constant C. 

Part (ii): Let D G G ]R nxn be the diagonal matrix with degrees of the nodes in G on its diagonal. 
Define D G * £R NxN analogously. From Eq. fl43b, it is easy to see that 



Now for any two matrices .4 and ,6, the eigenvalues of A ® are all products of eigenvalues of „4 
and i3. The matrix l/(m + 1)5 has eigenvalues 0, with multiplicity m, and 1, with multiplicity 
one. Thereby, 

(Tmin(I ~ D G l /2 A G ,D G l J 2 ) > mm{a min (I - D^ 2 A G DZ 1/2 ), 1} > Cr 2 , 



where the last step follows from Remark 2.2 Due to the result of jS] (Theorem 4), we obtain 



^min 

— 1/2 —1/2 

where ci m i ni G* denotes the minimum degree of the nodes in G , and C Ut c* = I — D G J Aq*D g J 
is the normalized Laplacian of G*. Since d m i n! c* = (m+ l)d m ir i G > C(nr d ) 2 , for some constant C, 
we obtain 

ffminOCG-) >C(nr d )V, 

for some constant C. 



G Proof of Claim 5.5 



Fix a pair G E(G*). Let = |Qj D Qj |, and without loss of generality assume that the 

nodes in Qj n Qj are labeled with {l,--- , my}. Let = £g. n g. 5 for 1 < ^ < d, and let 
Zfc = (2^ . . . , z { k d) ), for 1 < k < mij. Define the matrix G M a!xd as M|j? = for 

1 < f , i < d. Finally, let ^ = {pf* - $\ ■■■ , pf ] - $ d) ) G R d . Then, 

II EOf } " ^ II 2 = > ^in(M^))||^|| 2 . (44) 

In the following, we lower bound <T m j n (AfW)). Notice that 

VTlij 17l{j 171 ij 

M™ = £ z fcJ # = X>*4 " E(^^)} + ^ E(z fc j#). (45) 



fc=i fc=i fc=i 
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We first lower bound the quantity tTmin (Sfc=l ^( z k z k))- Let S 1 £ M rfxd be an orthogonal matrix 
that aligns the line segment between X{ and Xj with e\. Now, let z k = Sz k for 1 < k < m«. Then, 

TTlij TTlij 

Y J n z kz T k ) = Y J s T n z kzi)s. 



k=l 



k=l 



The matrix E(%zJ) is the same for all 1 < k < m™. Further, it is a diagonal matrix whose diagonal 
entries are bounded from below by C\r 2 , for some constant C\. Therefore, & m i a (Y^k=i ^C^^iD) — 
rriijCir 2 . Consequently, 

a min C^2E(z k zl)) = o- m in(^jE(z fc ifc)) > m^Cir 2 . (46) 
fc=i fc=i 

Let = z k z\— E(zfczJ), for 1 < A; < mjj. Next, we upper bound the quantity ^max(]Cfc=i 
Note that for any matrix A £ M dxd , 

o-max(^) = max x T ,4y < max V] I 4ra 1 1 I 

y " " " " y " l<p,q<d 

d d 

< max \A vo \ ■ max() \xJ) • max(> \y a \) < d max \A V0 \ 

- i<p, q <d l m lMi=i v f-f' p \\y\\=i vz -r q '~ i<p,Q<d l m 

Taking A = Y^™=1 z{K we have 



P =i 



9=1 



fc=l 



fc = l 



> — ) < d max 



l<p,q<d 



Z_> P<? 



k=l 



> 



d 



(47) 



where the last inequality follows from union bound. Take e = Cim^r 2 /2. Note that {2p?}KKm tJ 

is a sequence of independent random variables with E(Zp^) = 0, and \ Z^\ < r 2 /4, for 1 < k < rrii 
Applying Hoeffding 's inequality, 



/ ■/ P<? 



fc=l 



> 



Cimijr 2 
2d 



< 2exp 



2C 2 m; 



d 2 



< 2n~ 



Combining Eqs. (47) and (48), we obtain 

rriij 
k=l 



> 



Cimijr 2 



< 2d 2 n~ 3 . 



(48) 



(49) 



Using Eqs. (45), (46) and (49), we have 



k=l 



k=l 



with probability at least 1 — 2d 2 n 3 . Applying union bound over all pairs £ E(G*), we obtain 
that w.h.p., o- min (Mfe')) > C 1 m ij r 2 /2 > C(nr d )r 2 , for all (i, j) £ E(G*). Invoking Eq. (EI}, 



E^f-^) £ 2n Cj H 2 >C(«A 

£=1 



C{nr d )r 2 Y^W ~ # 



{(■) R (t)\2 
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H Proof of Claim 15.6 



Proof. Let N = \ V(G*)\ = n(m + 1). Define ^ = (l/N) YlZi and let 5 = v 
Then, the vector v has the following local decompositions. 



Eti^ (£) ^ (£) - 



CQ i = E(# ) -^ ) )€+W + 



•«' 



(0 



£=1 



where 7i = 7« — X^Li j^y( x Q^ ttg,)- For convenience, we establish the following definitions. 
M € M dxd is a matrix with Mg£i = (x^\x^). Also, for any 1 < i < N, define the matrix 



M (i) € R dxd ag M (i) = (x^^x^). Let 







and r?f = ^I'M^pf 1 . Finally, for 



3(0 



any 1 < ^ < d, define the matrix 6 



<>Nxn 



hi 



as follows. 




if 3 i Q l 

v, note that (vQ i , x^q) = YLe'=i ^t\^i ^ = vf'' '■ Writing it in matrix form, we have B^v = rf® 
Our first lemma provides a lower bound for ^(B"). For its proof, we refer to Section 



H.l 



Lemma H.l. Let G = (V,E), where E = ■ dij < r/2} and denote by C the Laplacian of G. 

Then, there exists a constant C = C(d), such that, w.h.p. 



B^(B^) T hC( 



nr 



d\ — 1^,2 



r z C, Vl<£<d. 



Next lemma establishes some properties of the spectral of the matrices M and M®. Its proof 
is deferred to Section IH.2I 

Lemma H.2. There exist constants C\ and C2, such that, w.h.p. 

a min (M) > Cm, a max (M») < C 2 (nr d )r 2 , V 1 < i < N. 



Now, we are in position to prove Claim [576| Using Lemma H.l and since (v, u) = 0, 

\W l H 2 > *^{B®{B®) T )\\vf > C(nr rf )-VV min (£) > Cr^vf, 
for some constant C. The last inequality follows from the lower bound on o~ m m(£) provided by 



Remark 2.2 Moreover, 



1 2 



£'=1 



(v,xW) 2 <MV^ 2 <Cr-%W\\ 2 \\x®\\ 2 . 



Summing both hand sides over £ and using ||x^)|| 2 < Cn, we obtain 



< 
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Equivalently, 



d d N 

t=i 1=1 i=i 



Here, /3 = ■ ■ ■ , G M d and ft = (/3f \ • • • , G M d . Writing this in matrix form, 

N 

||M^|| 2 <C(nr- 4 )^||M«/3,,|| 2 . 



Therefore, 



< in (M)p|| 2 <C(nr" 4 ) 



i=l 



max o" r 

Ki<AT 



A' 



(M») ^Hftll 2 - 



i=l 



Using the bounds on <T m ; n (M) and (T max (M^) provided in Lemma [h.2[ we obtain 

N 



2 <-(- d ) 2 E 



n 



Now, note that 



i=i 



E<W = E (%^) =^Eii^ (<) ii 2 . 

£=1 1=1 V ' £=1 



AT d AT 

II 2 



EiiAii 2 =EE^-W=Eii^ w ii 2 - 



i=i 



Consequently, 



E 

£=1 



=1 i=l £=1 

! =Ew w ii 2 +Eii^ w ii : 

(a) 

(*>) CN 
< 



1=1 

+Eii^ w ii ; 

£=1 



71 



>r d ) 2 EiiAii 2 + Eii^ir- 



- -! 1=1 
d 



^(i + ^k^eii^iP 



< C(nr d ) 3 J2\\P^(P^)f 



Here, (a) follows from Eq. (51); (b) follows from Eq. (50) and (c) follows from Eq. (52). The 
follows. 
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H.l Proof of Lemma IH.ll 



Recall that e%j E M. n is the vector with +1 at the i th position, 



everywhere else. For any two nodes i and j with 
uniformly at random and consider the cliques Q\ 
Sij = {Qi, Q 2 , <2 3 }- Note that 5 - C cliq*(G). 



1 at the j th position and zero 
i — < r/2, choose a node k E Cj n Cj 
Ck, Q2 = C k \i, and Q 3 = C k \j. Define 



Let a\, 0,2 and 03 respectively denote the center of mass of the points in cliques Q\, Q2 and Q3. 



Find scalars Q 



$ j \ and $ j \ such that 



0; 



(53) 



1. 



Note that the space of the solutions of this linear system of equations is invariant to translation 

of the points. Hence, without loss of generality, assume that ^2 x\ = 0. Also, let m = \C k \. 

ieQi,i^i,j 

Then, it is easy to see that 



(i 1 



%i ~\~ Xj 



in 



02 



m 



«3 



x 1 
m ' 



and the solution of Eqs. ( 53 ) is given by 



(ij) 



m 



S2 



x j 
m 



S3 



X 3 

m 



Firstly, observe that 



a 



For t £ C k and i 7^ 



.7 



a 



3 J 



1. 



+ £ 2 



a 9 



4°) 



Therefore, 



Qi,i 



+ e 



X Q 2 



Qa,t 



if t = i, 
if t = j, 

if i E Cfc,i / i, j 



(54) 



Let E be the vector with £J 



# } and 



at the positions corresponding to the 



cliques Qi, Q2, Q3 and zero everywhere else. Then, Eq. (54) gives 



Secondly, note that ||£ 



(«)||2 



(£ j) ) 2 + ($ 3> ) 2 + (^3 UJ ) 2 < ^2, f o r some constant C 



;(ii)\2 



C 
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Now, we are in position to prove Lemma H.l 
For any vector z £ M. n , we have 

( Z ,cz)= £ ( eij ,zf= £ <e«M«>*> a = E ( E efHt^V 

< E ( E K« ly, i 2 )( E <*&.»>•)< ui« W) ii 2 E<,*> 2 ( E i) 



< °(nr d )\\BWzf. 
Hence, B^{B^) T h C(nr d y x r 2 L. 
H.2 Proof of Lemma HO 

First, we prove that <7 m i n (M) > Cn, for some constant C. 

By definition, M = £™ =1 Xjxf. Let Z 4 = x { xj G M dxd , and Z = l/nE^i^i- Note that 
{Zj}i<j< n is a sequence of i.i.d. random matrices with Z = E(Zj) = 1/12/dxd- By Law of large 
number we have Z — > Z, almost surely. In addition, since er max (.) is a continuos function of its 
argument, we obtain a mSiX (Z — Z) — > 0, almost surely. Therefore, 

o-min(M) = no- min (Z) > n(a mm (Z) - cr max (Z - Z)j = ~ o"max(^ - Z) 

whence we obtain <r m j n (M) > n/12, with high probability. 

Now we pass to proving the second part of the claim. 
Let rrn = \Qi\, for 1 < i < N. Since h 0, we have 

W ||2 ^ r<™ . r 2 ^ 



a max (Af«) < Tr(M«) = £ WSf < Cm 



With high probability, m; < C(nr ), VI < i < N, and for some constant C. Hence, 



max a max (M«) < C(nr d )r 2 , 

Ki<N 



with high probability. The result follows. 



I Proof of Proposition 6.1 



Proof. Recall that R = XY T + YX T with X, Y £ R nxd and Y T u = 0. By triangle inequality, we 
have 

\(xi - xj,yi - yj)\ > \(xi,yj) + (xj,yi)\ - 1(^,^)1 - \(xj,yj)\ 
— i f) i _ l^il _ I I 
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Therefore, 

^2\(xi - xj,yi - yj)\ > E -n^2\Ra\. (55) 
Again, by triangle inequality, 

^2\(xi-Xj,yi-yj}\ > ^2\n(xi,yi) + ^{xj,yj) - (a^E^i) - (E x i>2/*)l 

ij i j 3 j 

= n^2\(x i} yi) + -^2(xj,yj)\, (56) 
i j 

where the last equality follows from Y T u = and X T u = 0. 
Remark 1.1. For any n real values £].,••■ ,£ n , we have 

£l& + £l>^El&l' 

i i 

where £ = (1/n) 



Proof (Remark 1.1). Without loss of generality, we assume £ > 0. Then, 

£i6+a> E6^(E6- E&) = ^Ei&i> 

where the second inequality follows from £\ £j = re£ > 0. □ 
Using Remark [Ll] with £j = (xi,yi), Eq. ( [56] ) yields 



Combining Eqs. (55) and (57), we obtain 

\\K Kn ,x(Y)\\i =Y^\(xi- xj, yi - y 3 )\ > jjr||i?||i. (58) 

ij 

which proves the desired result. □ 



J Proof of Lemma 6.1 



We will compute the average number of chains passing through a particular edge in the order 
notation. Notice that the total number of chains is 0(n 2 ) since there are (g) node pairs. Each 
chain has 0(l/r) vertices and thus intersects 0(l/r) bins. The total number of bins is 0(l/r d ). 
Hence, by symmetry, the number of chains intersecting each bin is 0(n 2 r Consider a particular 
bin B, and the chains intersecting it. Such chains are equally likely to select any of the nodes in 
B. Since the expected number of nodes in B is @(nr d ), the average number of chains containing 
a particular node, say i, in B, is Q(n 2 r l /nr d ) = 0(rar -1 ). Now consider node i and one of its 
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neighbors in the chain, say j. Denote by B* the bin containing node j. The number of edges 
between i and B* is Q(nr d ). Hence, by symmetry, the average number of chains containing an edge 
incident on i will be @(nr _1 /nr d ) = @(r _d_1 ). This is true for all nodes. Therefore, the average 
number of chains containing any particular edge is 0(r _a!_1 ). In other words, on average, no edge 
belongs to more than 0(r" d_1 ) chains. 



K The Two-Part Procedure for General d 



In proof of Lemma 6.2 we stated a two-part procedure to find the values {\k}{i,k)eE(Gi) that 
satisfy Eq. (21). Part (i) of the procedure was demonstrated for the special case d = 2. Here, we 
discuss this part for general d. 

Let dj = {i} U {j} U H\ U • • • U be the chain between nodes i and j. Let F p = H p n H p+ \. 
Without loss of generality, assume V(F P ) = {1, 2, • • • , q}, where q = 2 d ~ 1 . The goal is to find a set 
of forces, namely /i, • • • , f q , such that 

9 9 
^ fi = x m , *y fi A X{ = 0, 
i=l i=i 

£ll/*ll 2 <c||x 



1=1 (59) 



|2 

u m\\ ■ 



i=l 



It is more convenient to write this problem in matrix form. Let X = [x\, x-i, ■ ■ • , x q ] G m dxq and 
^ = [/is • • • ) /o] £ M rfX9 . Then, the problem can be recast as finding a matrix $ G M rfxc( , such 



that, 

$u = Xm, X§ T = <S>X T , 

„ „2 „ „2 ( 6 °) 

Define X = X(I — l/quu T ), where I G M 9X|? is the identity matrix and u G M 9 is the all-ones 
vector. Let 

§ = -^x m u T + {-^Xuxl l + S){XX T )- 1 X, (61) 

where S G W lxd is an arbitrary symmetric matrix. Observe that 

$u = x m , X<S> T = <S>X T . (62) 

Now, we only need to find a symmetric matrix S G M. dxd such that the matrix $ given by Eq. ( |61| ) 
satisfies ||3>||f < C||a; m ||. Without loss of generality, assume that the vector x m is in the di- 
rection e\ = (1,0, ••• ,0) G M. d . Let x c = ~Xu be the center of the nodes {xi\ q i=l , and let 

x c = (x c l \ • • • , x c ^)- Take S 1 = — |l x m|l x e^eief . From the construction of the chain dj, the nodes 
i x i}i=i are obtained by wiggling the vertices of a hypercube aligned in the direction x m /||x m || = e\, 
and with side length f = Sr/Ay/2. (each node wiggles by at most |). Therefore, x c is almost aligned 

with e\, and has small components in the other directions. Formally, la^l < for 2 < i < d. 
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Therefore 

d 



1 Xux^ n + S = (y^x^e,) • (||x m ||ei) T - ||a; m ||xWe 1 ef 



y i=l 

d 



=2 



Hence, JXns^ + S G M dxa! has entries bounded by |||ic m ||. In the following we show that there 

exists a constant C = C(d), such that all entries of (XX T )~ 1 X are bounded by C/r. Once we 
show this, it follows that 

U^xux'i + s)(xx T y l x\\ F < c\\ Xm \\, 

for some constant C = C(d). Therefore, 

\Mf < \\-x m u T \\ F + \\(~Xux* + S)(XX T )- l X\\ F < C\\x m \\, 
q q 

for some constant C. 

We are now left with the task of showing that all entries of (XX T )~ l X are bounded by C/r, 
for some constant C. 

The nodes Xi were obtained by wiggling the vertices of a hypercube of side length r = 3r / A\/2. 
(each node wiggles by at most r/8). Let {zi}j =1 denote the vertices of this hypercube, and thus 
— Zi\\ < |. Define 

Z = -[zi, ■ ■ ■ ,z q ], 5Z = ^X-Z. 

Then, XX T = f 2 (Z + 8Z){Z + 5Z) T = r 2 (ZZ T + Z), where Z = Z(5Z) T + (5Z)Z T + (5Z)(5Z) T . 
Consequently, 

(XX T )- l X = -{ZZ T + Z)~ l (Z + SZ) 
r 

Now notice that the columns of Z represent the vertices of a unit {d — l)-dimensional hypercube. 
Also, the norm of each column of 8Z is bounded, by ^ <C ^. Therefore, fmin 

(ZZ T + Z)>C, for 

some constant C = C(d). Hence, for every 1 < i < q 

WiXX^XaW < l - a ^ n (ZZ T + Z) \\(Z + 5Z)e i \\ < j, 
for some constant C. Therefore, all entries of (XX T )~ 1 X are bounded by C/r. 



L Proof of Remark 17.1 

Let 9 be the angle between o 
In the basis (a, a±), we have 



Let 6 be the angle between a and b and define a± = \\b-^s^)a\\ • Therefore, b = cos(9)a + sin(#)aj_. 



T 

aa 



1 




bb T 



cos 2 (6) sin(0)cos(0) 
sin(#)cos(#) sin 2 (0) 
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Therefore, 



\aa T — bb T \\2 



sin 2 (0) - sin(0) cos(0) 
sin(0)cos(0) -sin 2 (fl) 



| S in(0)| = A /l-( 



M Proof of Remark 7.2 



Proof. Let {Aj} be the eigenvalues of A such that Ai > A2 > • • • > A p . Notice that 

\\A-A\\ 2 >v T (A-A)v 

> ~\ p {v T v) 2 + Vill^WII 2 - \ 
= ~\ p (v T v) 2 + ~\ p - 1 (l-(v T v) 2 )-\ p 
= (A p - \ p -i){v T v) 2 + A p _i - A p . 

Therefore, 

( V T~\2 > A p-i ~ Ap - \\A - A\\ 2 
Ap-i — A p 

Furthermore, due to Weyl's inequality, |Aj — Aj| < ||A — A||2- Therefore, 

,t~ )2 > A p _i-A p -2||A-i|| 2 
" A p _ 1 -A p + 2||A-l|| 2 ' 
which implies the thesis after some algebraic manipulations. 



43 



N Table of Symbols 



n 


number of nodes 


d 


dimension (the nodes are scattered in [— 0.5, 0.5] rf ) 


L G R Ttxn 


/ — —uvt?~ where / is the identity matrix and u is the all-ones vector 


Xi G R d 


coordinate of node i, for 1 < i < n 


x (l) G W i 


the vector containing the I th coordinate of the nodes, for 1 < I < d 


X G R nxd 


the (original) position matrix 


X 


estimated position matrix 




Solution of SDP in the first step of the algorithm 


Qo e K™ xn 


Gram matrix of the node (original) positions, namely Qq = XX T 


Subspace V 


the subspace spanned by vectors x^\ ■ ■ ■ , x^ d \ u 


i2 G M nxn 


Q-Qo 


# e R nxn 


PvRPv + PvRPJf + PvRPv 




V y 




\i G V(Ct\ ' d,»A < v l e 2\ ft hp nodps in C» form a, rlioiip in G(n, r')') 




iC) U \d\k\hcc 


cliq(G) 


S 1 ! u • • • u s„ 

J_ — 1 L 


Si 


Sj c VYGH • w. . < r 12(112 + 1/100H 

{Cj, Cj\ii, • • • , Cj\i m }, where i±, • • • , i m are the ?n nearest neighbors of node i 


clia*(G) 


iSl U • • • U Sr,\ 


G 


G(n,r) 


G 


G(n,r/2) 


Gjj 


the chain between nodes i and j 


G* 


the graph corresponding to cliq*(G) (see page 13) 


TV 


number of vertices in G* 


£ G M nxn 


the Laplacian matrix or tnp grapn G 


/* c ItpnXn 
I, t K 


the Laplacian matrix of thp graph G 




c^Tfitit; m pi t* l v 
oLiCoo niaiiiA 




rigidity matrix of the framework Gx 




For a matrix Y G R nxrf , with rows yj \ i = 1, • • • , n, 


xg g Rl^l 


ft G ,x(>0 = i? G (^)^, where y = [yf , • • • , £] T 


restriction of vector x^-* to indices in Qj, for 1 < I < d and Qi G cliq(G) 


x^ G Rial 


(£) . i (£) 

component of Xg orthogonal to the all-ones vector UQ i , i.e., P^ Q Xq, 


> 


coefficients in local decomposition of an arbitrary (fixed) vector v G V 1 - 

fe = Eti/3f ) ^!+7^Q ! +^ ) ) 


/?W G R w 


GSjV- ,/3^),for£ = l,..-d 




average of numbers i.e., (1/iV) ^i^-i ft-^ 






Pi G M d 


W for i = !,-■■ ,N 



Table 1: Table of Symbols 
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